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Using the Carleman linearization technique the continuous iteration of a mapping 
is studied. Based on the detailed analysis of the Carleman embedding matrix the 
precise mathematical meaning is given to such notion. The ordinary differential 
equations referring to continuous iterations are identified and the discussion of the 
relationship between them and the corresponding iterated maps is performed. 



I. INTRODUCTION 

There are well known examples of how to relate a continuous time differential system 

x(t) = F(x(t)), 

where F : R fc — > R fc , to an iteration of a map of R s into itself. We only recall the Euler's broken 
line method and the Poincare map. An example of the inverse procedure to the discretization has 
been recently discussed in jlj . Namely, a precise meaning has been given therein to the notion of 
a "continuous iteration" of a mapping, that is a continuous counterpart of the iterates 

The purpose of this work is to introduce an alternative formalism for the study of the continuous 
iterations based on the classical Carleman linearization technique which is more general than the 
approach taken up in [jj]. In section II we briefly introduce the Carleman linearization technique. 
Section III is devoted to the detailed analysis of the properties of the Carleman embedding matrix 
which are crucial for the actual treatment. Based on the observations of section III we find in 
section IV an explicit formula on continuous iterations of a mapping and show its connection 
with a linearization transformation for a corresponding recurrence. The theory is illustrated by 
an example of the logistic equation. In section V we introduce the ordinary differential equation 
referring to the continuous iteration and find a simple relation between the Carleman embedding 
matrices corresponding to the continuous and discrete time cases. 



1 



II. THE CARLEMAN LINEARIZATION 



We begin by recalling the Carleman linearization technique . Consider the system 

x = F(x), (2.1) 

where F : — > R k and F is analytic in x. Having in mind the applications of the Carleman 
technique in the study of the iterated one-dimensional maps discussed in this work we restrict for 
brevity to the case with k = 1, i.e. the ordinary differential equation (2.1). On making the ansatz 

Xj :=x j , j = l,2,..., (2.2) 

where x fulfils (2.1) we arrive at the infinite linear system 

oo 

Xj — S ' LjkXk , (2-3) 

with the constant coefficient matrix Ljk- Clearly, in view of (2.2) the finite system (2.1) is embedded 
into the infinite system (2.3). Therefore, the Carleman linearization is also referred to as the 
Carleman embedding technique. Recently, the Carleman approach has been succesfully applied to 
the solution of numerous nonlinear problems (see Q and references therein). We only recall the 
application of the Carleman linearization technique for calculating Lyapunov exponents Q] and 
finding first integrals for the Lorenz system [5| . 

As shown by Steeb || the Carleman embedding can be easily generalized to the case with 
nonlinear recurrences of the form 

x n+ i = f(x n ), (2.4) 
where / is analytic in x n . Indeed, in analogy with (2.2) we set 



(2.5) 



where x n fulfils (2.4), which leads to the infinite-dimensional linear system of difference equations 
such that 

oo 

x jn+l = ^ MjkXkn- (2.6) 
fe=0 

As with the case of the ordinary differential equations the finite-dimensional recurrence (2.4) is 
embedded into the infinite linear system (2.5). 

III. THE CARLEMAN EMBEDDING MATRIX FOR NONLINEAR RECURRENCES 

In this section we study the properties of the Carleman embedding matrix for nonlinear recur- 
rences specified by (2.6) which are utilized in the actual formalism. We now return to (2.6). Let 
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M(/) designate the Carleman matrix referring to the recurrence (2.4). Equations (2.4), (2.5) and 
(2.6) taken together yield 



so 



Let 



k=0 

i d k (f(x)y 



M jk (f) 



kl dx k 



x=0 



(3.1) 



(3.2) 



(3.3) 



k=0 



The matrix M(f) can be alternatively defined with the help of the coefficients of the expansion 
(3.3) as 



M jk (f) = < 

The first few elements of the matrix M(f) are 



/mi fm,2 ' ' ' frrij 

m i + m 2 + ■ • • + m j — k 
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for j > 1. 
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We remark that usage of the formula (3.2) or (3.4) is not the most effective way of calculating the 
elements of the matrix M(f). The simpler possibility is to apply the relation 



2tt 

M jk (f) = ^J e^ifie-^ydtp, 




(3.6) 



following directly from (3.1) and the well-known fact that the functions of the form e mip , where 
n = 0, 1,2, form the orthonormal basis of the space of the square integrable functions on a 
unit circle. 



Example: Consider the logistic equation 

x n+x = nx n {\ - x n ). (3.7) 

Using the relation (3.6) we easily obtain the following formula on the elements of the corresponding 
Carleman matrix M: 
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\k-j ( 3 

(the vanishing of Mjk in the case with 2j < k is understood). 



M jk = (-l)*->l k J _.)S C-!.n. 



We now focus our attention on the mapping 

f^M(f). (3.9) 

A remarkable property of (3.9) is that it provides a representation of a semigroup of analytic 
functions with multiplication defined as the composition operation, that is 

M(fog)=M(f)M(g). (3.10) 

The relation (3.10) is an immediate consequence of (3.1). Clearly, 

M(id) = J, (3.11) 

where id(x) = x is an identity function playing the role of a neutral element for the semigroup of 
the analytic functions, I is the identity matrix, and whenever exists the inverse / _1 of /, then 

Mir 1 ) = M- l {f). (3.12) 

Finally, it is clear in view of (3.10) that iterations f n of a function / are represented by matrix 
powers, i.e. 

M(/«) = M"(/). (3.13) 

Having in mind the form of the relation (3.13) it is plausible to define the continuous iterations / 
of /, where t is a real parameter, by 

M(f) = M*(/). (3.14) 

Thus, the problem of the precise definition of continuous iterations can be reduced to finding the 
powers M of the matrix M for a non-integer t. 

We recall that the infinite-dimensional (anti)representations of the formal power series were 
originally studied in [Q. The counterpart of the formula (3.10) introduced therein describing the 
anti-representation is of the form 

B(f o g) = B(g)B(f), (3.15) 



where B(f) are the Bell matrices specified by 



1 dPjfjx)) 



j, fc = l,2,..., (3.16) 



4 



and it is assumed that the function / given by the formal power series satisfies /(0) = 0. We point 
out that such assumption is rather restrictive one and it is not satisfied in such important cases as 
for example f(z) = z 2 + c, related to the celebrated Mandelbrot fractal. Evidently, we have 

B(f n ) = B n (f). (3.17) 

As with (3.13) the relation (3.17) was the point of departure in pj to define the continuous it- 
erations. Nevertheless, the approach taken up therein is less general and it seems to be more 
complicated than that introduced in the next section of this work. We finally remark that in 
opposition to the actual treatment there is no interpretation of the Bell matrices B(f) provided in 
connected with an infinite-dimensional linearization of the original nonlinear recurrence (2.4). 



IV. POWERS OF THE CARLEMAN EMBEDDING MATRICES AND CONTINUOUS 

ITERATIONS 

As mentioned in the previous section (see formula (3.14)) the problem of the precise definition 
of continuous iterations reduces to finding the non-integer powers M 1 of the matrix M(/). Our 
purpose now is to discuss this point in a more detail. We first observe that the problem under 
investigation can be furthermore cast into determining the transformation diagonalizing M such 
that 

M(f) = U^AU, (4.1) 

where A is diagonal, i.e. Ajh — ^jSjk- In fact, (4.1) leads to the following formula on the powers 
of the matrix M: 

M t (f) = l/- 1 A t l7, (4.2) 

where (A*) i& = \)5j k . 

In order to diagonalize the matrix M we first bring it down to the triangular form. Consider 
(2.4). Let us assume that x n = is a stationary solution to (2.4), that is x„ is a fixed point of / 
such that 

/(z*)=z*. (4.3) 
As with ordinary differential equations we can switch over to new variables 

"^n ^ n (^*^) 

so that the resulting nonlinear recurrence 

x'n+i=9«), (4-5) 
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where g(x' n ) — f(x' n + x*) — a;*, obeys 

9(0) = 0. (4.6) 

Using the definition (3.4) one can easily check that the condition (4.6) leads to the upper triangular 
Carleman embedding matrix M(g). Further, we have 

g = hofoh-\ (4.7) 

where 

h(x) = x — x*. (4.8) 
Using (3.10), (4.7) and (3.2) we arrive at the matrix relation of the form 

M(g)=T x ,M(f)T~\ (4.9) 

where T Xf = M(h), and 

M-i® 1 -^ bll> - k ' (4.10) 

I for j < k. 

Evidently, 

i , (t)xi k for j > k, , 

(T-% = { (4-11) 
I for j < k. 

We have thus shown that the Carleman embedding matrix M(f) corresponding to (2.4), where 
/ fulfils (4.3) can be reduced by means of the transformation (4.4) to the upper triangular form 

M{a). 

Now let 

oc 

g(x)=J29kX k . (4.12) 

fc=0 

Taking into account (3.4) and (4.12) we find that the diagonal elements of the matrix M{g) are 

Mu(g) = g\ = = (^)\ i = 0, 1, 2, . . . . (4.13) 

These elements coincide with the eigenvalues of the matrix M(g) specified by 

1>M{g) = Xip, (4.14) 

where ip is an infinite row- vector. Suppose now that the eigenvalues = Mu(g) of the matrix 
M(g) are mutually different. Since X{ = g\ = A 1 , therefore we then have the restrictive conditions 
A ^ and A 7^ \/T. It is easy to verify that the transformation diagonalizing M(g) of the form 
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M(g) = V^AV, 



(4.15) 



where A is diagonal, is given by the following recursive relations: 

fc-i 



1=3 

1 



k 



l=j+l 



for j < k, 

for j = k, 
for j > k, 

for j < k, 

for j = k, 
for j > k, 



(4.16) 



(4.17) 



and 



Ajk = 



jk- 



(4.18) 



Finally, combining (4.15) and (4.9) we find that the transformation diagonalizing M(f) can be 
expressed by (4.1), with 



U = VT Xt . 



(4.19) 



We are now in a position to define the desired continuous iteration /*. Indeed, eqs. (3.14), (3.1) 
and (4.1) taken together yield the following formula on /*: 



f(x) = J2(M t )ik(f)x k = ^(U-'A^Ux' 

fe=0 k=0 
jklm 



(4.20) 



On introducing the functions fk(x) such that 

\ Er^v^Vkii* - x*y 

I 

we can write (4.20) in a more compact form. It follows that 

oo 

/*(x) = ]TA fe V fc M. 

fe=0 



for k > 0, 
for k = 0, 



(4.21) 



(4.22) 



Thus it turns out that the problem of the definition of continuous iterations can be brought 
down to the solution of the eigenvalue equation (4.14). Further, it is straightforward to show that 
the matrix V satisfying (4.15) satisfies the relation (3.4). Using this we find that the matrix V 
can be expressed by the solution to the eigenvalue equation (4.14) with the help of the following 
relation: 
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V 3 k=Y, V J-^k-u (4.23) 
1=0 

where ipk are the coordinates of the vector ip . Now it is not difficult to check that besides of 
the matrix V also the diagonal matrix A specified by (4.f8) fulfils the relation (3.4). On passing 
with the use of (4.1) and (4.19) from matrices to functions we arrive at the following functional 
equation: 

f(x)=u-\Xu(x)). (4.24) 

where u — v o h, and V — M(v). Clearly, the functional equivalent of (4.2) is of the form 

f\ x ) = u - 1 (X t u(x)). (4.25) 

It thus appears that the problem of the definition of the continuous iterations can be alternatively 
cast into the solution of the functional equation 

u(f(x)) = Xu(x). (4.26) 

The equation (4.26) is known in the literature. For example in Q it was used for finding explicit 
solutions to nonlinear recurrences (2.4). We recall that the solution u(x) of (4.26) is simply the 
linearization transformation 

x' n = u{x n ), (4.27) 

reducing the solution of the nonlinear recurrence (2.4) to the linear one 

<+i = A<. (4.28) 

We point out that the connection of the functional equation (4.26) with an infinite-dimensional 
eigenvalue problem was found for the first time by the second author in the context of the 

Hilbert space description of nonlinear recurrences (2.4). The formula on continuous iterations 
analogous to (4.22) in the particular case of /(0) = was originally obtained in jl[] with the use 
of the finite-dimensional truncations of the Bell matrices. We finally remark that our experience 
indicates that the recursive relation (4.23) on the matrix V is of practical importance for the 
numerical solution of the functional equation (4.26). 

Example: Consider as an illustrative example the well-known exactly solvable case of the logistic 
equation (3.7) with fi = 4 

x n+1 =4x n (l-x n ). (4.29) 

Using the identity 
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arccos(2x 2 — 1) = 2arccosa;, < x < 1, (4.30) 

we get the solution to the functional equation (4.26), where f(x) = 4x(l — x), of the form 

A = 4, (4.31a) 
u{x) = ±[arccos(l - 2x)] 2 . (4.31b) 

Finally, taking into account (4.25) we get the desired formula on the continuous iterations such 
that 

f( x ) = I{1 - C os[2* arccos(l - 2a;)]}. (4.32) 
Referring back to (4.22) we find 

z*=0, h(x)=x, ^ = 0, <p k (x) = |(-l) fc+1 laXCCOa Qu) 2X)?k ' k - h (4 - 33) 

Thus the well-known solution to (4.29) of the form x n (xo) = f n (xo), where f n (xo) is given by 
(4.32) corresponds to the fixed point x» = of f(x). We now discuss the solution corresponding 
to the second fixed point x* = § of f(x). On utilizing the identity 

2ir — arccos(2x 2 — 1) = 2arccos:r, — 1 < x < 0, (4.34) 

we arrive at the solution to (4.26), where 

A = -2, (4.35a) 
u{x) = \ arccos(l - 2x) - |. (4.35b) 

Taking into account (4.25) and (4.35) we obtain 

f\ x ) = i{l - cos{(-2)*[arccos(l - 2x) -?f] + ^}}. (4.36) 

It can be checked with the use of (4.22), where x* = | and h(x) = x — | , that the obtained 
solution really refers to the fixed point x* = |. Furthermore, a straightforward calculation shows 
that the function (4.32) is equivalent to (4.36) for non-negative integer t, that is the solutions of the 
logistic equation (4.29) corresponding to (4.32) and (4.36), respectively, such that x n (xo) — f n (xo), 
coincide. Clearly, (4.32) is different from (4.36) for non-integer t. We conclude that in the case 
with the logistic equation (4.29) the continuous iteration is not unique. It should be noted that 
such ambiguity was not recognized in Q|. In fact, the solution (4.36) cannot be obtained by means 
of the approach introduced in jjj . We also remark that uniqueness of the continuous iterations 
referring to (4.29) is violated by the existence of the multiple equilibria for (4.29). It is suggested 
that it is the case for the general recurrence (2.4). We finally point out that due to the term (—2)' 
the function f (x) given by (4.36) is complex-valued. 
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V. FROM ITERATED MAPS TO CONTINUOUS TIME EVOLUTION 



In the previous section we have investigated the continuous iterations f*(x) referring to the 
recurrence (2.4). Since we can interpret the continuous parameter t as a "time variable", therefore 
the question naturally arises on the dynamics of f t {x). Consider the continuous iterations f t (x) 
and the corresponding powers of the Carleman embedding matrix M t (f). We have 

oo 

(f(x)y = J2( Mt )jkx k , (5.i) 

fc=0 

^-M t = In MM*. (5.2) 
dt K ' 

Eqs. (5.1) and (5.2) taken together yield 

lf( x )=G(f(x)), (5.3) 

where 

oo 

G(x) =]T(lnM) lfe x fc . (5.4) 

We have thus shown that the continuous iterations /* (x) satisfy the ordinary differential equation 
(5.3) subject to the initial condition /°(x) = x, i.e. /* is the flow corresponding to (5.3). Of course, 
since /* (x) is a flow therefore the vector field G can be expressed by /* (x) with the help of the 
well-known relation 



G{x) 



df\x) 



dt 



(5.5) 



An alternative form of the vector field G can be obtained directly from (4.25). Indeed, differenti- 
ating both sides of (4.25) with respect to time we get (5.3) with 

j . , , , du^ 1 (u(x)) , . ,„ „. 

G(x)=lnA )-^u(x). (5.6) 

dx 

Interestingly, there exists a remarkably simple relation between the Carleman linearization of the 
differential equation (5.3) and the Carleman linearization of the original recurrence (2.4). In fact, 
on setting 

*,•(*):=(/*(*))'•, (5.7) 
and using (3.1), (3.14) and (5.2) we arrive at the infinite linear system 

oo 

xj = ^2L jk Xk, (5.8) 

fc=0 

where 

L = In M. (5.9) 
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Thus the logarithm of the Carleman embedding matrix related to the linearization of the recurrence 
(2.4) is simply the Carleman embedding matrix describing the linearization of the differential 
equation (5.3). We finally remark that whenever the solution f n (x) to (2.4) is chaotic then it is 
plausible to expect that the solution f t (x) of the differential equation (5.3) is also chaotic. As 
is well-known, the definition of chaotic systems presents a delicate problem, nevertheless it seems 
incredible that the one-dimensional autonomous system (5.3) would exhibit in any sense the chaotic 
behavior. The following example provides a possible solution of the problem. 



Example: Consider the continuous iteration (4.32) corresponding to the solution of the logistic 
equation (4.29). An immediate consequence of (5.5) or (5.6) and (4.31) is the following differential 
equation satisfied by j t {x): 

df(x) 



dt 



| In 2 sin{arccos[l - 2/*(x)]} arccos[l - 2/'(x)]. (5.10) 



Notice that the principal part arccos(x) of the inverse cosine obeys < arccos(x) < n, therefore 
the right-hand side of (5.10), that is d ^Jf^ , is non- negative. On the contrary, in view of (4.32) 
/*(x) oscillates. We conclude that /*(x) cannot satisfy (5.10) for arbitrary t. Indeed, an easy 
inspection shows that /*(x) satisfies the following differential equation: 

®M = G(t,x,f(x)), /°(x)=x, 0<x<l, (5.11) 

where 



G(t,x,f(x)) 



In 



| In 2 sin{arccos[l - 2/*(x)]} arccos[l - 2/*(x)] for < t < 

-iln2 sin{arccos[2/*(x) - 1]}{tt + arccos[2/*(x) - 1]} for - Es^EEM <t<- 



ln • 



(2fc + l)- 
n p k-( l-2x) 



| In 2 sin{arccos[l - 2/*(x)]}{2fc7r + arccos[l - 2/*(x)]} for (1-2.) <f< 

-\ In 2 sin{arccos[2/*(x) - l]}{(2fc + l)vr + arccos[2/*(x) - 1]} for ' 2x) < t < '" |n . 



In ■ 



a(l-2x) 



for< - hT^- 

for x = 0, (5.12) 

In 



where fe, Z = 1, 2, Thus, it turns out that (5.10) holds only for < t < "' "^^ 2x) . Neverthe- 
less, in view of (5.12) the form of G is determined completely by (5.10). In fact, the continuation 
of (5.10) expressed by (5.12) is evidently implied by (5.10) and the fact that the inverse cosine is 
the infinitely-many- valued function. It seems that the adequate denomination for (5.10) would be 
the "principal part" of (5.11). As with (4.29) the differential equation (5.11) is also chaotic. In 
fact, by (4.32) < /*(x) < 1, and the Lyapunov exponent a is 
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a = km - In 

t— »oo t 

As expected, this exponent coincides with the Lyapunov exponent for (4.29) [[nj. Notice that 
the chaoticity of (5.11) does not contradict the well-known fact based on the Poincare-Bcndixon 
theorem that the minimal dimension of the phase space of the chaotic autonomous system is three. 
As a matter of fact the nonautonomous equation (5.11) refers to the two-dimensional phase space 
with coordinates /* and t. Nevertheless, becouse of the non-periodic dependence of the vector 
field G on the time variable t, the volume of the phase space occupied by the trajectories of the 
autonomous system corresponding to (5.11) is, in contrast to the assumption of the Poincare- 
Bendixon theorem, infinite one. 



df(x) 



ch- 



in 2. 



(5.12) 



VI. CONCLUSION 



In this work it is shown that the Carleman linearization of nonlinear recurrences defines the 
matrix representation of analytic functions. Such representation enables a sound definition of 
continuous iterations. On introducing the infinite-dimensional eigenvalue equation (4.14) related 
to the problem of the definition of continuous iterations and translating it back into the language 
of the composition of functions, we have arrived at the functional equivalent (4.26) of (4.14). As 
we have mentioned earlier that equation can be met in the literature. Nevertheless its application 
in the context of continuous iterations as with (4.25) is most probably new. In opposition to the 
alternative approach introduced by Aldrovandi and Freitas jl| the interpretation is provided in 
the actual treatment of the matrices representing functions in terms of the infinite dimensional 
linearization of the original nonlinear recurrence. We have also identified the (finite) dynamical 
system corresponding to continuous iterations, and we have found a simple formula (5.9) relating 
the Carleman embedding matrices in the discrete and continuous time cases. We note that the naive 
approach to the continuous iterations corresponding to (2.4) relying on the formal replacement of 
the discrete variable n by the continuous one t suggests only the delayed equation x(t + l) — f(x(t)) 
which is equivalent to the infinite dimensional system of ordinary differential equations. The 
simplicity of the approach taken up herein suggests that it would be a useful tool in the study of 
nonlinear recurrences as well as their continuous counterparts. 
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